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ABSTRACT \\ 

^ Theory is a usefulv guide for program design and 

implementation. This paper uses a large-scale school-based ^ 
delinquency prevention project to illustrate the use of theory i 
prpgram design and the need for line staff to have a clear 
understanding of the program's theoretical underpinnings . Evalua 
result^ for the j^rpgram show that the iprogram was effective for 
reiiucing the level, of ^delinquent behavior and changing a number 
theore\:icar precursors of delinquent bepavior at the school leve 
The program, however , failed to bring al^out the desired changes 
behavior and attitudes of individuals targeted |or, special serVi 
The differential effectiveness of* the program Icomponerits is 
attributed, in part to differences in the ecKteox to whi 
implementation was guided by theory . ^.(Authfe^r) » 
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^ . . ' Introductory Statement ' ' u 

The. Center for Social OrgaflizatiQn of Schools j^SOS) has ^wo primary ^ 

. /' objectives: to, develop a scientific knowledge of how schools affect their, 

students, and ^ use this knowledge 'to develop better' school practices and 

* organization. ' ^ ' « ^ ^ . , , • 

* . The Center works through three- research pro-grams to achieve its 

^ objectives: • * ' 

The School Organization Program investigates how s c hoo l^and ^^Jk^^r oom 

organization affects student learjiing and other impieidiate outcomes of ' , . 

sdhoollng,;' Current studies focus on 'parental involvement, microcomputers 

' . ^ • ' . t 

in scl-MB^ols, '\use of time in schools, cooperative learning, and. other- organlza- 

' r\ rr. V.>,V"" , ' * , ' * I . ' 

- tional stlrategies that alter the task, reward ,V authority and peer group 
structures, In schpols and ^classrooms . ^ ' . . , 

, ' *jXhe Education and ^ork Program examines the relationship between scboplin 

and students '^plater-life occupational ancf educational successes . Current 
projects XT^Qj^^f^ studies of the competencies required in ' the' workplace , the 
soytces or\Jyfkining and experience that lead 'td employment, ^college, stuflents * 
major field choices, and -emfjloyment of lirban minority youth. 
^ The Schools and Delinquency Program st;udies - the problems of '-crime, 
violence, vandalism, knd disorder in^ schools and ^the role that schools play 
in delinquency. Ongoing projects" a^ddresss^tl^e development of a theory of 
delinquent behavior, . school effects on delinquency and the evaluation of ^. 
delinquency prevention programs in an^ out of schools, 
y CSOS also supports a FeLlowships irl Education Research program that 

provides opportunities for talented researchers fo conduct and publish 

significant tesearch in conjunotion with the three research programs, - , 

A. * ' y ^ * ■ • 

This report, prepared by the Schools dnd Delinquency Program, examines 

the effectiveness of using theory to guide a large-scale educational inter- 
vention designed to reduce delinquency. 





ii 



Theory is a useful guide for program des^ign and implementation* 
This paper usfes a^ large-scale school-based delinquency prevention pro- « 
ject- \o illustrate the use o£ theory in:program design and the need ^ 



\for line staff, to have a clear understanding of the pv^ogram's theoret- 
ical underpinnings. Evaluation resultp for the progra^ show that the' 
ptogram was effective for reducing the level of delinquent behavior 
and .changing a number of theoretical precursors of delinquent behavior 
at the schQol leveK The 'program, .however,-' failed to bring about the 
desired changes in behavior and attitudes of individuals targeted fai , 
,Bpec«al services. The differential ^effectiveness of the program com-' 
ponents is attributed in -part to differences in the extient to ^jHichNr^ 
implementation was guided by . theory. 
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Implemeivting a* Theory in a L|rrge-6cfale . 
Educational Intferv*ent*k)iC - 

■ ' ■ '•, I. 



A clear idea about - the nature and causes of the pl*©Mem is an essential 




gui/le to program development. Organizational development efforts ^that 
explicitly con'^ider the causes of > the problem to be addressed will be more 
eff^cfive tiian those ffxat develop without, benefit of such a theoretical 
framework. A report by the Panel oh Research on Rehabilitative Techniques 
(Martin, Sechrest', ^ Redner, 1981) points out that in the absence of an ad 
quate conceptual framework, in^terventions' of ten are unrelated to the' causes'^ 
of the problem, ignore suitable target populations^ and * fail --to consider 
questions of optimal timing and strength of the intervention. 

'■2 ■ - ' . .'■ ■ 

Theory ife also/essential for the organization 'apd communication of ideas. 
•In\research and in practice,' w^ .wish to test ideas about the causes of 
soc.iaI problems as well as specific strategies designed tp reduce ,'the level* 
of thfe problem. A clear statement of the theoretical' rationale benin4 a 
program increases the probability that something useful will be learned from 

"the trial^^M^d that this useful knowledge will be communicated to others.^ 

' ■ ' . i' . ' ' 

This papet yses a, large-seal e school-based delinquency prevention project 
t/) illustrate the need for. line staff to have a clear understanding of the 



program^'s^ theoretic-al underpinnings. Programs designed with the benefit- of 
. explicit theoty "are not always ^implemented according to the saifte. theory .1 



J The project on^ which this .paper is ba^ed operated in ?even secondary, 
fchools ;in Charleston, \South Carolina. It, is a* school -based delinquency 
^ prevention- program designed ^an^ operated by. tfee central Vadministrati^ of 
the city's school system. The project participated in formative evaluation 

. activities structure4^by ^he Program" Development Evaluation model XCottfred- 

' • V ■ . . ■ " ' ■ 
son, G. , in press; Gottf.redson, Rickert^ Gottf redson, & *Advani , ' 1983) . This 

...» . i ' • ... / 

''frtoework for prografii development emphasizes the importance . of explicit 
'"^theory iti organizational * development/ a(5t ivxtj.es. . • , 



The Theory , 



Init iaj^Theoiw 



No r^fferettce to academic theories of delinquency was made in the initial 
grant prop([)8al for the project • The main' theme of the proposal was that 
school disorder stems from the school system's failure ^to take a proactive 
approach to disiiplin^ and tcr^tailor curriculum misterials and instructional 
techniques to the needs pf students. The ptojepfc proposed to revise ^Isci" 
plin^ proce*|jK4re8 and policies using <.a preventive approach,^ to clarify the 
curricf^liim object ives and focus them more on students.'^ diagnosed /needs, and 
to provide opportunities for 8tuden4f57^teachers, administrators, parents and 
other^'community members to engage in school improvement efforts. In addi- 

^^tion, the project propo^ed-to ^i^ovide intensive tutoring and cbunseling to 
100 "target students" in each school identified as being most in need .of 
project services. ' Although the >r^o^ai^ was clear about ttie goals of the 

•■SVroj^ct arid about 'the general '^ap^roafch' that, would guide, program ^ctiv it res; 
.it was, by Wogram .'Development.^lfvaluat standards (Gottf r^dson, Rickeri^ 
Gcyttfredson,> & Ady&ni, 1983), lacking in ^a plear sta.tement of the intermedin 



,r -ate behavioral and attitudinal , changes that the projeckHnteiided to bring 

^ ^' '■■ ^ ■• ' ■ ', ' ^'"^ • , ^ '„ , ' ^ " , * , ■ V •; 

about. •':/: ■ • ■ ' . . r 

• ••• ■ ■ : ■ ■ . .; . V ■ • ,.• , -rM.. 

,^ meetings with' the .project' nlanagers revealed an eclectii/ loosely ^ 

• connected theory and, a set of thiirty-two discfete' planned piog^L' activi- ."V 

. • . \^ ties. The theory resembled a list that mi-ght ' bis' .generated . if , one were to' 

■' . ■ '"■ ' ' ^ , ■ ■ ' ' i- ' ■ ' ' 

^ , pull key variables from every major theory of delin^ency knd to add to it ' ^ 

■ '. • . ' ■■ ■•■ \ 

vai/iables relating to .local sources that cantribute to the schools^ prob- ' 

al^. thirty-seven causes of delinquency"^ere named, j The planned „ 
program activities, sho^ggd high-^ongruence with the theory, sugg^ting tliat' ' 

intermediate causeis of the problems the program Was" addressing had been cbn- ''' 

■ ■ . ■ ' ^- • ' ^ ' ' " ■" ' ' ■ ' "' ' • ' 

' . . ■ ; sidered ^in; the design of tlie program^ Only five .of the • thirty-sevW c^usar 

: ' L ' ■ ■ ■■<^ ■ ^ "'.,.1 ■ ' 

variables, mentioned during the thebr'y-generation staglfwere' iiot addressed ' 
directly by the initial ly-pr&posed program. 



The_ Evolved Theory - - . y 

t> ' • ' ^ . ' ■ ' ' ^ ' ■ ■ , • ■ ^ 

Prograjn development activities to* remove redundancies and clarify causal / 

^ links in the program's action theory prodiiced the theory shown in Figure 1. 

• ' ' : ^ ' ■ ^ ^ ; ; \ r ' 

This versibn of, tlie theory identifies a critical triangle of interrelated 
student behaviors ^nd aJttitudes thajt must change in order to reduce delin- * 

quent behavior and increase * educational., and occOpatiohal , attainment. It 
^ . ' . * . • ' ■ ^ , . ■ '•' ' ^ ' ' . ■. 

emphasizes five school factors' that must be altered in order to bring about* 

^ the desir ed chan^'es in student beha\/iors and attitudes. The theory . as sunes 

that socioiBconomic factors ' affect the family, ^school and student factors,! ^ 

. ^ but maKes j:l^ar that tlie locus tdf intervention, of- ^the program is -the school c 

. 'and thjat tti^e, programme effect 'on thfe community will result from - long^tei?m 

• ^ ■ , , , .Si ■■• ■ ■ 
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V 



"changes in the characteristics of the individuals inhabiting the conununityj 
rather than througli direct intervention. ^ ' * ' ' 'v- 



Operational izing the Theory 



By the midpoint '6£ the project , the program managers had reorganized "the 

9j^^inal thirtyrtwo project activities into five major areas of interven-^ 

tion. This groupitig of activities with similar objectives helped to focus 

program activities. «The reconceptualization in turn hejfped the managers to 

J / 

reach consensus about the k^y focal points of the program and t^ elaborate 
the relatively parsimonious theory shown in Figure*!. 

\ The major interventions and their primary objectives elaborated by the 
midpoint of the project were as followg; 

The project's primary interventibn was tQ .establish^ and. maintain an 
organizational structure which facvit^ted shared decision making among com- 
munity agencies, students, teachers, school administrators arid parents in 
the management planning for the school. . The project provided training in 
assessing n^eds , researching problems, defining objectives and developing 
and implementing plans, assessing progress and redefining strategies. It 
established a team structure to implement school change, as well as a strucr 
ture fo»w review and rjevision of school policies. 

Team Structure s 

Most school-wide innovations were accomplished through five teams. TVo 
proj ect staff persons in eac\l' school — the Cutriculum Specialist and Student 
Concerns Specialist — shared responsibility for organizing tjie teams ^ and 



monitoring the activities .of the teams. The cqmposition and purpiose of t\e 

' : ' ^ V ' \ • . ■ '.' : ' ' / V ■ • ■ 

) •• . . ■ - • ^. J ^ , ■ ' ■■ ■ i ■ • 

fivtf teams were: - ^ * ; 

: ■ ■ V • * ■ : — . ■ ■ ■ 

•■ ■ ■ , • • ■•\ > \, ■■ ■ ■ •■ ■ 

IStudent Concerns Support Team ; * Five faculty -^^^.v 

worked with the Student Concerns Specialist to plan^ctTvitiei^ " to improye . 
school climate and. the behaviof of ,individual students* ; 

Curriculum Support Team , Five . f acul ty members representing Che. major 
academic areas worked with the Curriculdm Specialist to plan and implement 
activities to iuiprov£ academic performance. 

Student Leadership Team , " A group of^ at least ten students planned and 
implemented activities to improve the school. Development of leadership 
skills in the team members was a primary objective of this intervention. 

Parent Leadership Team , Parent groups composed of at^le^st ten parents 

' I . ^ > ' ' ' ' ' ' 

were organized a^ traihetl to plan anfi impj-enient activities to improve ihe 

* * ^ ' ' ' 

schobl> environment / ' * • ' * . * ^ 

Business/Education* Partnerships ,^ The project worked, to^ establish an 
active, productive partnership . for each: of its schqols with a busxness in 
the- community'.' The primary purpose of. these partnerships was to ^provide 

management .aT>,d publ ic relations expertise to schools* ■ ^? ■ 

• * • '■ ' ' • ■ 

The primary objective of this tVam structure was. ^paroving school manage- 
ment. Although specific, activities carried out by the teams oft^n had pther 
x>bjectives, the o^^nization of sc^ool^^and community pe^rspna into t^atas and 
the management training and experience provided through ^the teAms: were tar- 
geted directly ».at • improving school, managetoent. * 



Policy Reyggv and Revision St wc tare 



V ^ . ■ V ■ ' ■ • . ■ ,• ^ \ ;. . ^ . . . . ■ . *. 

^ Cifrricul um Review. and Revi^ibn >^ Acrhievement test results were used td 
diagnose school -wide academic- ye^nesses, the . Curriculum Specialist , , in 

; A' • . - ' ■ ■ . . . ■ ■/ • ■ . * ' 

cooperation with the Gurricijlwn Support Team, used the resulting information 

■' . ' ■ " ' , ' ^"^'^ ' * ' • ' 

to plan and carry ^out remedial progigps. these incliided .ongoing Faculty 

Development through in service training, ^^n^jiew teaching techniques such as 

Student Tejam Learning (Slavin, in press). A.'curriculum ' resource room was 

establ^hed and its use monitored by^ the Curriculum Specialist^. *. Resources 

■ '/ ' ' ' . ' ' ' ' ' f ' 

included self^instructional activities , books and magazines for free read- 

ing, and pther suppl emeta^tary instructionaj. materials. Both teachers ^and 

studjents were encouraged, to use. the ^ redoprces provided^" This intervention 

was directed at increasing teacher competencies and ^ at • imp^roving school . 

administration in curriculum development and delivery. ^ , ^ V ■ 

Discipline Review, and Revision .' The Student Concerns^ Specialist, with/ 
,the S;tudent Concerns Support Tepm, reviewed information about discipline 
problems in the school and planned and carri(3*d out actiy^itieflT designed to- 
address, those problems. Emphasis was placed on student involvement in the 
development of^ school and classrodb rules, the estabLishment of a discipline 
referral procedure and the" tj^e of a st andardized discipline referr^ form. 
The Discipline Review and Revision component included ongoing fa,culty devel- 
opment through inservice training. This intervention was^ aimed ■ at improving 
teacher competencies in the area of classroom, management and at improving * 

. . ■ ,' ' ' ' ' ". , . ^ ■ ' • 

school management in the discipline area. ^ . ' 

\ • . ■ ■•• . 

' For the innovations described abpve, what .the teams implemented was not 

.A • ^ • , \ s ' • , 

considered to be as important as the process the'^teams went through to, plan 



iimtfvatiol%|4' carry it'fdj^ard. . The. curriculuni and discipline .policies 
thajt- ^merged from^lliie . Reviev^ and Revision component mattered les* to the 
project iuplementers tl%>.4he management practices the teaiu^ used in 
addre^ing the educational and^Klsi^jfline problems the schools faced. 

•In conjunction with the process innovfei^^^^^^^^^ the 'program used^^specif ic 
sets of school-wide academic innovations, climate innovations, car^er-ori- 
ented innovations, 'and services to target students. 

School-Wide Academt^-Innovations , 



. Study Skills . The Curriculum Specialists provided studfents ' with mini-, 
* , courses' on study^ , skil Is (e.g., note-taking,' listening., skills, good study 
' habits), and also served as resource petsoiis for teachers in developing and 
implementing study skills units .for their classes. 

Readiflk Experi'Pnc«. Program '. A period ol time was set aside in tlie school 
, schedule fpt fVee reading for everyone in the building. Teachers, staff, 

' 'and administrators as well as students were encouraged to participate and 
students wer;^^ recognized for active ^rticipation. 

Test Taking Program . The Curriculum Specialist distributed and monitored 
Vthe^use of .Math and English practice testrf for CTBS and state-wide tests. 
Teachers were encouraged to use the tests throughout the ye,ar on at least 
■ • -ten separate occasions. The specialist al so organized and implemented on . a 
sc^iool-wide basis activities tflTch as providing test-taking tips to parents, 
tekchers and students, and promoting positive attitudes toward test taking. 
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' Field Trip Program * * The project provided additional resources to the '\- 

. , ' ■ ■ ■• ^ 

' schools ' to assist with field trips in; cultural, academic and career areas 

■ ... - ' ■ ■ . : . ' • ■■: ■ ■ ■^'•k; ' ■ : - . 

which supported the project'^3 go^als and objectives. ^oject sta£f members 
conducted £ield« trips themselves or spught the assistance o£ other teachers 
. , in conducting them. 

*^ Student Team Learning > Student; T^mq Learning is a set of classroom. 
in^tructi|oi:\al techniques ^hat \uses student teams composed of, ^students ef 

.'different abil ityv level s. Team members in STL classrooms study and drill 

\ ' ' ' , ' . ' \' ' 

together! and prepare «^or quizzes or cross-team competitions. Teams ^ earn 

i ' ' ''■ '* ' ■ , * 

rewards jfor improvement rather .than for the absolute learning oftheir mem- * 
bers. The techniques haVe received positive evaluations for enhancing 
lemming', self-concept, liking of scjiool and increasing cross-jrace aiid 
cross-sex ^friendships .(Slavi«, in press)* Teiachers in the project schools 
were offered training in STL techniques and were encouraged to implement the . 

' * ' . ' " ' ^4 ' , ' / ■ - . ' " " 

techniques in their classrooms. *' , ^ 

\ School-Wide School Climate Innovations/ ' ^ . 

This intervention ' iAyolVed specific programs aimed at enhancing the 
school) climate. The subcomponents fereT^ 

The School Pride Campaign . This involved students and teachers in activ- 

ities to im'prove the overall image of. the school* , . i ' 

" * * '■■.»■ 1 ' 

Expanded Extra-curricular Activities . The Student Concernsj Specialist 

enciouraged the growth of extracurricular activities on campus by assessing 

■ ' ■■ ■' " * * • ' ' ' ' , . . i' , - 

student needs, establishing needed activities^ , r'ecruiting . sponsors, and 

\, monitoring club progress. . 1 , ' , . 



Peer^ Cottttseling or TtAP Sessions , . Students were Wlected trained to 

participate ;vini^^ counsreling program, or, . alternatively, in adyltfSfi-- 



.^regfred }^ nn' ^at^piiiikJ** TKa ^nnynnQo moc to es tabi ish a f orum in, which s\u- 



dents co^X(i:f^^ topics of concern and ..generate peer pres-! \ 

^sureiitfb/ f^s^lye^cl^^ in a socially acceptable way,. 



i 



These fltctivities * were expected to alter i^ie school climate by changing 
the normatiye helief -structure -in th^ school to a jnore ptQspcial one, by 

- • ^ ' ■ ■ ' Ax 

Increasitxg cohesiveneffs anigng stUCTja»ts and teachers^ ^apd by .improving H 

* ' ■ ' - ' • ' ■ ' !' " 

mo^alev> The project^ sought to increase bonding to the . soci-al or der thVough 
'th'iff set of 'activities. . " ^ v * 

Career- Oriented Innovations . \ , • ' ' K' 



Carreer Exploration Programs . The projefct , in cooperation with a local 
technical college, offered students afc the >high school s opportunities ttr 
parti'cipate in two programs . <3esigne'd to ihjtroduce them to' technical careers 

■ -i • ' ' - - ■ • " ' ■ • • ^ . ■ 

such as engineering, computer science and industrial technology., 

• . - . . . \ . ^ ; ' i ■ ' ■ ' ■ ■ \ ' , ■ . 

Job-seekinp Skills Program . This intervention provided training in; spe- 
crfic skills ^r^lated t6 finding and keeping^ job (e.g. interview Qtj.quette) 
ah4 offered opportunities for broadened career. awarene&s. 'This intervention 
was aimed at increasing -the educational and occupational attainment of 

' ■ b . . > ■ 

youths by increasing their job-readiijess, and at increasing students' /com- 
mitm^nts to conventional goals.' ■ , s / • 

■ - . ' ■ ' ' ■ •'■'.'-•1. 



Services to xkr ^ Pf. Students- ' • . V. 

A major set of activities provided affective and academic, services »to 
^students in nee"d '.of intensive services! This program component macfe a spe- " 
clal effort to increase , the involvement 'and success experiences of -students 
whomay have already given up on their education. . Students who were eliei- 
ble foi^ tye direct ^ services (about ipZ>p( the 'students in J:h'e school iere 
selected), were identified anXjiagnosed. Their behavioral • treatment" objecr 
tives were defined, appropriate acadmic and counsel ing services prescribed,' 

awl progress toward objectives monitored and frequently reap6es6ed. Appr'ox- 

. ' ' ■ ' ' ' I, .' • . ' ■ ■ 

imately half of the specialists' time was devoted to providing these' direct 

services to target students*- > " * - , ■ .' . 



The "triangle" of studeot-level objectives in 'the Student Factors box in 
Figure 1 was the target of the direct ^ryice component. Counseling and 
academic services were intended to increase rewarding experiences, in school, 
increase self.-concept . arid strengthen students' , bonds to the aociai order. 

Implementation 

Monitoring the strength and fidelity of implementatioji in such a broad 
pr,ogr^' was a challenge. .The prograi^^nagers developed monitoring systems 
over the duration of the project to capture information bn the intensity and 
quality of program services. The monitoring system used data from two main 
sources : ' ' , 

■ i ■ ' :. ' 

(l)-"Program Development Worksheets" CPDW's) contained detailed manage- 
ment plans for all program activ,i,ties . Program managers specif ied implemen- 
tation standards for each progra^. com^nent -and us^^l the PDW^s to moMtor 

■■■ ■ • • ' / . ■ ■ ■ V 
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the extent to which they net, exceeded or fell shoit of . their . standar^s^;^,^^, 
Thesel worksheets were used to record monthly quaUty,..^ntt«fr't^ from meet- 
ing minutes, agendas, logs, and sj^ud^firfolders and from regular interviews - 
with school personnel. - 'the monitoring worksheets. coni:ain a^alth of infor- ^ 
mation about the qual ity of . project imprement.ation. . -The documents have not 
yet,' been coded and summarized for the 1982-83 school year, but tor the 
1981-82 school year they indicated that the program as a whole ijieX approxi- > , . 
jnately 75% oT its program standards . ' The school-wide academic interyfeiitions 
were i'bii^emen ted most faithfully, and the team-structure and career inter- 
ventions were w^l-implemented- only in -the high schools. School-wide affec- ' 
tive .interventions ;sych" as rap sessions, and extracurricular . activities were 
not as we/l implemented (Gottf redson,' 1983). ^" • , 

■ ^ ' V ■ . ^ • 

(2) Records of spe6ialist contacts with students provided a mor e ^readily- 
useable source of implementation data. Data on " the nature of each contact 
were systematically captured using sign-in sheetfe and. daily contact ^logs. 

■ These data were collected monthly . Table. 1 summariz^ contacts far the ^ 
1982-83 school year for the six school s. that, remained in . the program' for the,'^ 
/J982-83 school year. One school ^was dropped due to budget cutbacks. ^ ^ . 

Implementation, standards called for an ' average of three contacts per 
month with .each tarfeet student, or about twenty-seven per year. Table 1 
~ shows that-only one school, met the standard. However, the intensity of the 
direct service component: nearly Vripled over^ 1981-82 levels. During the 
1981-82 year the average number of contacts per target student per school 
ranged* from 3.81 to 13.67, With a total scliool average of . 6.86— less than ■ 
one contact per month foi' the average target student. For the 1982-83 year. 



Table 1 

PATHE Specialiist Contacts During 1982^-83 
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'v ' , 
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in school 


entire 
school 
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control 


— ^ 




— r 




Middle I (n=496) 








total ^fiffective 


.37 


1-.92 


.• 10.9-5 


:97 


Total Academic 


.14 


1 .09 


9 .42 


.08 ^ 


Total Career 


.04 - 


.08 * 


■ . . 04 




total Contacts, 


.39 


3 .09. 


20.40 


l.ll 


Middle II (n=548) ^ 




- • ■ 




Total Affective 


. 21 


i .11 


6.02 


.33 


Total Academic 


s,22 
^ .00 


•3 .02 


26.81 . 


.21 


Total Career 


.00 


.03 


.00 


Total Contacts 


.31 / 


4.14 


, 32.86 


. 54 


Middle III (n=48?r) 






■ ' ■■ ' " / 




\^ Total Af^ctive 


' . 17 ' 


' .82 


6.44 


' . 00 


Total Academic 


) .^2 ' 
^ . .00 


.1 .35 


12.10 


.00 


Total Career 


.00 


.00 


1 00 


^ Toltal Contacts'^ 


.20 


2 .17 


18.54 


.00 


High I (n=1116) 










*total Affective 


.08 


.66 


' 3.59 


.45 


Total Academic 


.14 


J 48 . 


3.93 ■' 


. ."21 


Total Career 


.06 . • 


. . 08 


• .04 ^ 


.03' 


Total Contacts 


.22 


1 .22 


7.56 


.69 


High il ("n«899) 




' A' ■ ■ 






Total Afflctive 


- .03 ■ 


.96 


4.39 


.61 


Total Academic 


.29 


1 .69 


12.12 


.67 


Total Career 


, .02 


.0.4 ■ 


• , . 00 


.Op 


"Total Contacts 


' .32 


2 .69 


16.52 


1.28. 


High III,(n=781) 






\ 




Total Affective - 


.52 


3*. 3 6 


. 7.83 


2.47 


Total' Academic 


.26 


' .76 - 


3.55 


.18 


Total Career . 




.08 


.08 


.02 


Total- Contacts 


, .62 


. 4 .20 


Ili46 


2.67 ■ 



Nbte. Affective contacts include contacts for Student Leadership 
Team activities, fieldtrips, extracurricular activities and youth 
conferences. Academic contacts include contacts fpr tutorang, stu-^ 
dy-skills session^, test-taking skill sessions and sessions during , , 
which ape^ialj^sta 'monitored the progress of students and diagnosed * " 
educational arid affective needs. Career contacts include' contacts 
fhr the career 'orientation programs and job-seeking skills^ sessions. 



the per school averages ranged. from 7*56 to 32*86, with 'a total school aver- 
age of 17. .89-r-about tvjo •contacts per^'month per target sj:udent. ^ - 

A program decision to intensify direct services coupled wj,th bAidget cut-. 

•backs for th« 1982-83 school year required a reduction of effort in school-" 

wide services. This shift is evident in the TabVg^J^igures on* percent of 

Students in the school contacted^ During the 1981-82 school year, between 

38' and* 77 percent of the students' in the project schools were involved, in. 

I * ' ' ' ' 

some documented project activity. The average percent contacted was oU 

percent. / Table 1 shows the range for the 1982-83 school year to be 20 to 62 
i>ercent, with' an average of 34 percent. This redaction in* school-wide con- 
tacts primarily affected counseling services to studenta referred by te^^H- 
erp for disciplinary , incidents. Most other school-wide services remained 
fairly, stable. ^• 



To ' sumioarize, the imprementatior 



data suggest that the direct service 



CQmpc(nent of the project was wejl implemented during the 1982-83 school 
year, although not aa strongly as intended. The intensity of school-wide 
Vervices is about as expected except tliat affective services in «igh schdols 
I .and it aire telatively low. -Future summarization of the Program Develop- 
'ment tJ^orkshe^t monitoring information will provide moire' precise data on the 

/ K^-'-' ■ . : ■ . ... ' . ^ \ ' . 

' quail ijiy pf?^.iprogram sei^v.ices- ^ • * • 

.:^':f: ■.' ; , ' . • ^ ' 

^. ;; '^.\ Effects, of the Program ^ 

' -This scWobl improvement project was part of a natibnal evaluation of sev- 
enteen prbjects that sought to reduce del^nqu^nc^thitough alternative educa- 
t@i. ^Gottfjredson,' G.D., 1982;. Gottfredson, Gottfredson & Cook, m^a. 



1983b).^ The results described below are derived from, these nationa^evalua-. 
tJ^ ac^^itieis. 



Data ' " ' > 

Surveys of ettidents and teachers in all the- project schools and iji two 
comparison schools were ponductedvin the Spring of 1981, a year later in.j||ie 
Spring o^f 1982, and on<ie ag^ain in the Spring bf 1983. All full-timfe teVch-vi 
ers ii!i the* schools were sampled,, and a random sample of approximately 200 
students^was selected each year from 'each scihool. All target, and - control 
Students were sampled with'' a prob^biitty 66 1*0 e^h year, A«-^were students 
who vere part of a prior ;^ar's random sample (thife was done to enablelong- 
itudinal studies.) Students identifiable in advance as educabl\ ^mentally 



retarded youths were excluded £rom .the ;saqipl6. Schqol averages presented in 
Tables 2 and 3. are based on school averages obtained by weighti 



ng each perr 

\ 

\ 



&on's respbnse^ by, the inverse of the probability with which tTTfe~-i>erson *was\ 
sampled. ^ v - ' * V. - 



Evaluation De sign ' \ ' , . ' , 

^ ~ ■ : ""^^ — • , ' 

A trye , experiment was ui\pl^ented t-o evafy'^te the? effectiveness of ser- 
vices, to target students The procedures for the initial randomization 
which occurred ^before the beginning of the 1981/82 school year are ((escribed 
in detail elsewhere (D. Gottfredspn, '1983). Post-raitdomization ch^ecks on 
pre-treatinent discipline , and .academic measures indicated ^thatx equiv,alence 
was achieved.' All 1981-82 treatment and cont^jpl students remaining in the 
project schools for- the 1982-83 year remained in the experiments No signi- 
ficant treatanent-Qontrol dif feVences in attrition from the study j^ere 



■ / ■ 



Z3 



detected. Treatment and. cont^r^ol slots lef t ^vacant by attritiph were filled> 



by randomizing from a fjbol of students in each school -who scored low on 
s.t'a^ard^zed' achievement tests, Vece^^ pfoor grades or had presente^ 'disci- 
linary groblians during the previous year, iXn all, 124 sti^dents were added 
to the tre^Jment and * control groups in this way. The* perceatage of nfew 

^ ' ■ ' ■ ' ' . : ■ , ^ *"y - 

treatment apd controL students ranged from ' 0 percent in two middle schools, 
'to 33 percent in a high school. Post-randomization checks' using pre- treat-^ 
ment standiardized achievement test scores and survey measures of gander, 
race,, age, and parental education level imply that the target and control* 
groups for the^ 1932-83 school year remained equiy^a.lent, ' . ' 



The^ffects of ^'chool-level interventions are alssessed by examination of* 

• ^ ' • ^' '.; ' ' , , ■ : . ; ' "''•(' 

year-to-year differences in school averages on measures* of the project's 
goal^ aiiid objective^. Two non-project schools--Qne high' and one middle-'-' 
-were selected for ^comparison with the projecfe^schooLs, All nine schools 
were .surveyed in Spring,. 1981 and Spring, 1982, ' ► 

The school district underVent a major' school reorganisation in Fall," 1982 

• Which thfew ^ monkey-wrench^ihto' the final year^^of our school- lev el >eyalua- 

ti,on. 'The higb school comparison school was closed, and students from the 

xiomparison, scly)ol and two 6f tke project high schools were reassigned to on^ 

'o,f the remaining . two schools on' the • basis x)f their grade level;.' We were 

•unable^to disentangle the ef^e'cts of ^he program- during t^e 1982-83 'school 

year from the effects of the reorganlzati-'on ^f pr tt&se' 'three^high schpols, 
' ■ 4 . . - ' ♦ * ' - ' / , , ■ , ^ 

For this reason', results for only, the 1981-82> school year will be\pre^ented 

^for the high , 'schools. - ' . / ' 



W \BVdget cutbacks in the third year required that the progfaitf be discontih- 
^ukd^'ift one of the middle schools. We kept this v<Jropped-,schbrol ("Middle IV") 

in this ^rvey sample to enable an assessment of the effects of pulling th-e 

■ \ ■•vV. .• ' • ■ ' ' ' ■ 

prbgram out of thte schop^^-- -a poor mane's ABA design' (Cook & Campbell 1, 1^75)- 

^ . ■•.^ . : - ' ' ' ^ \ ■ ' • ' ' . . ■ , ■■, ' ,^ 

Results for . th is school are,,sho>m separately for the two «yQars« \ . ) ' 

Me assures ' ■ ^' ' ■ 

The measures ^examined fi^ve been describedi^lsewhere (Got tf reds on', QgaWa, 
Ric^ert/& Gottfredson, 1982 Gottf redson et al • , 19833^, The foil o<j-ing pro- 
vides an overview of the measures, all of which ^e b^sed on sel^admitlis- 



tered quest ioiitte ires* The measures based on student survey responses 
i*riclude:< . 



lienat ion . This scale measures the extent to which the students feel' 
estranged frqfm the aocial order. > * / \ . ^ \ ^ 

Attachment to school « This scale, based on reports that the studetit 
likes school, measures an element of Hirschi's (1969) social bond. 

^ Belief in conventional rules ./ This^^^c^le is based on student reports 
th^t taking ' advantage of ' othets^_hr:e^king rules, -^tc. , arye OK* It also.meaT 
sures an element, of^ the social bond according to Hirschi (X969). I 

Inyolvement . This is' a checklist measure of participation in a variety 
of fi^chool aotivities. > ' ' * . 

, \ ■ ^ \ 'V' ' ■■ ■ ■■ ' 

' ) Self-concept . This scale . me asures students ^ self-este^ combined with 
^their conception of tti^ems^elves as prosocial, law-abiding citizens* ^ 

g^chool non-attendance . This is a tjwo-item 'index of class .cutting , and 
school cutting- . ' - . \ ^ 

Self-report^ delinquency, . , This sfale is based on J9 items asking 
whether thes^espondent has committ^ed various illegal 'behaviors in the past 

Educat ional expectat ion . This is the response to a single questionnaire 
item asking how farr the student exjpect 6 to go in school./ 

' School rewards .J ,<^is scale is based oh students' . repor ts that they ha^jr^ 
been rewarded in . various Vays in schogl , for , their recent school be^av ior^. / ^ 



. School puivishmerit s , This jsrcale is ' bdsjpd on ptude.nts^ reports, ^h at tliey 
. have *been punished in yar.ious ways in school for,^ their' recent sfchool behayj-^ ' * <; 

• ior . ...^ ■ ■ '\ *■ ' ■ '• ' ' " : . ■ • < ..^ - 

. Rule Fairness > ^VThis [three-item^ ^f^l^ is based on student reports that 



the school , 
-sdme for 



ool .rules are faV^' that , the punishxnea^^ rules, is thi' *• ' • \ - ' 

r everybody,' and;. that the prlixciRQ,!^ ^ fii " T 

Clarity * .This ^aggregate-level ac'al^e i*s xomposeH (jf qu^st,ion6 aiskin^/ ^/g.:. * 



. Rule. Clar ity , This ,aggfegate-l , ^ . . 

^ whether every one; knows what the rules>arr^> Whether teacheris let thfe students 
: kjiov whijt is expected*, and whether the .prinqipal /^i^^ • ■>^, - *iV 

• • ' . . , • • ^ ; ^ ^ ■ •. ..;„• : / » , - ;\ 'rli' 

. ^Victimization . Thip is a. fiye7it:em scalev based on' ■ stadent ^ reijorts of ;,. 

,perspnal, yict iiaizatibn. ' , V .\ ' * - * ' i" '4 *. ! ^ r 



The next f^ve" mejasiir es^ a^e based on teacher- suifyey', responses ; , ; 

■ ■■■■ ■■' . ■ ■ ' • ' V' 

Teacher* Mo'falg: l^ 'This 11-item ^cal e «m^asurea ,teai,cher moral e ^ items ^ 

such 'as ,> "Our problems iij; th is , scj?iool are., so ^{g 'tha^^^^^^^ is *uiif ea^ ist ic to' 
expect teachers to.make tnuch. of a\dent ..In th^." • j " ^ r/' 

*" '' ' ■ , ' 'T o/'' ' ' ' \ ' ', '■■ ' , . ', " . ■ . 

, L6v Expec tat loiig, . .Thi^ ^o-item ^^al e ' asks; t ed<jhers ^^to judgfe what per- 
cen^^ag^^ofTlTei^^ ^nd hjave "behavior problems.!' 



PlanjiinK & ActiW , O^stym "How often ;do you work ori^^^ ptatining . 

committer 'with- othetSe^cU^^/^^ comprl&e th is rnri^-item scale ^wh.ich m^asut^a.y' . , . 
(he ^extent to which the/ AC^^ an or ganization^.. engages , :sy^t emktic; • 

planning and is open to changes. ,V > , ' ? , i 

' ' , ■ ' \ , ' 't^' >rf' ■ . /• V A . 

•Safety. This 10-item '§Cale measures, teacj^ers' .pVrceptiorre of the ".safe ty ; 
of their schbols. ^ ' ^ . V ' . \ , " 

^ , , ^ . ■ ' ' ■ ■ ' 'V' ■ , 'V - • ' Js; ' .. 

Victimization . . ; Thi^ eight^item scale,, basfed' on teacher ^ ireports of.p^r- -r^. . 
s^^nal victimization, ask*: teachers to^ report on'* victimization, experiences . 
ranging froth obscene remarks 6r gestures to physical attack- V . . . 

^" \'-'^'' / . . • : \ ■"• . 



^ " Results "^/^ ... ♦ 



1 

s 



- Sc hool Level . , ~ - ., ' . "** " ' - 1 

Tables 2 throiigV 4 ' slyjw evaltia t iolT r esuA^ f or\t^^^ 
• gr^ syrvices. /Th]^ tables show only resulta for t^eapures, of Variables that. ' 



are central 'to .tltt^ctibn theory ( see Chen . 6^ Ro^si'. 1983). 6ther veva^=i^U£n, 
results are sunmrar ized or the^l*^l-82 "j^ear; in Got'tf redson < 1983 ; 1984), 
'Tables '2 and 3 show X-statiigtics for the difference in ;scftooI. means f.or, the 



t-8tati8tic8 for Year-to-Year Differ fences on -A' • 
School Averages for .Indi-vidual Level Outcoioea^ ' , 

♦ #^ . ^^J^^^ ^^^^ J^^l..^^.*— .-^« 

Individual Level Outcoije Survey Measure » , 

.„„: „. i'.„.„„..- - . 

Total School , School Positive .'School; Ediic. 

Dalin- School Punish- Nonat- : Self Attach: Expect- Involve- 

ations nifint 




School^ ' 


qilency 


Rewards 


ments 


tendance ' 


Concept 


meht 


Middle I ' , 




1.55 


-.85 


Jl . 


i;42 . 


1.4& 


Middle II 




-2.14* 


-:49 


.1.73 


1.Q8 


2.35* 


Middle^ III 




1.4?" 


' .51. 


-.6-9 


2.29* 


3.47** 


Middle IV (interrupted) 












1.17- 


81-82 




.60 


, .98 


, .67 


1.04 


82-^3 




-1.81 


3.66** 


-1.24 


-.21 


-.80 


Middle V (coipariaon) 




■ -1.85 


1.26 


.77 ^ 


1.21 


-2.01*- 


High I 


-1.92 


' -.84 , 


-2.40* 


, -.()5 


.66 ; 


■ ..83 


.High II 


-1.08' 


.16 ■ 


■-1.40', 


-.94 


2.97** 


rl.56 


.tfigh^ni 


. -2.05* 


.25 


, ■ -.61 


-1.18 


.70 


-.63 


High IV (•(;oinpari60n). 


■ -.09 


■ -.75." 


.45 


-1,77 ■ 


2.08*' 


-1.23 



r 



4m ' 

-.18; 
2».41* 

.11' 

-•77 . 
1.49 

-.69' 
1.88 
,38 
-1.52 



-1.17 

•-.09 : 

-.89 

• -.10 . 

-,86' ' 
- -'.(15 

-1.07 - 
.73 . 

U6 V' 
-.56. 



I. J''. 



Note. The deairecl^direction of change is positive except for- School Puni8hments,^Total' Delinc^^^ and ' 
School Nonattendance.' All measures are taken from the SAES student surveys; Middle Schools I through , 
III and High Schools I th'rou^h III received project services 'from September, 1980 through'May, 1983. 
Middle School IV received project services from, September, 1980 through May, 1982. ^ Middle School V and , 
High School IV never received .project services.. Delinquency was not measured in,1981| in the Middle 
Schools. Middle school ^'statistic^ reflect diffefrences tfrom Spring, 1981, to Spring,' ^983. ' lligh school 
t.-8tatistics reflect differences from Spring, 1981 to SprW, 1982. 
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Table 3 

X"6tatis^ics for Vear-to-VeariDifferchces on 
School Averages "for "School Level Outcooec r 
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. j.65** 


2.88** 
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. .20 ■ 


-.15 


, .11 , 


.1.25 ' 


' .,32 


-l.V ■ 


.68 


.'.59 


igh II • , ^ ; 


. .85 


-1.26 


-.29 


1 .40 


. 02 - 
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-*2-.88** 


» ■. ,'34"* 
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Pi.?^ desired direction oi change is positi^Ve except fpr Low Expectatioas and At ieno t ion. * 'Al 1 measures /are taj^en 

rcn^^lie SAEU ^tvfdcnL and teacher surveys. Cltmate measures, i.e., scVles composed oL'student and teacher reports, ^f 
he school climate^ were, constructed using itemS'|that hj^d bqen aggregdlj*<»d id the schooli^^leve).. - Tljc "X-^^ ^ti,st i c^* for 
hticc seal cs . (CI ar ity of Rules, Fi^imese of'Rules.*, Safe_ty , Teacher Morql e , PI onning and Actioh, anjj Smooth Admini'stra- 
ion)'is the ratio of the difference between the dean for the later ye'aV and the IjhseUijie year t:p*<iie st andard eriTor of 

„ ' r •* I _ 1 nOO _ ! ■ r _ __ _i i i i _ ^ _ l « i inn J _ ^ - • * f __ r « j i . ' ^ _ ^' _ i C t ^ l . ' r t t _ i l <«' \ _ _ >i - - '-i 



Middle ichoolt I thrbugii^ III and IPigh Schools'l 
1983. [ iliddle School IV received project $er- 
througli Ma^, 1982. fiddle School V and High School fV never received prbjett services'. Mid- 
le sahaol X— statistics reflect difYerences from Spring, l98Ji,*to SpriiJg>^.V1983 . ttigh school X^s^^tistics fgf lect.'tiif'*- 4 
orences f rora*-Spr ing^ 1981 to ^Spring, 1982. " ,^ \„ - ' . 



casurt-incnt of *tlie. 1982 scores for all , schools in ^hc OJJDP initiative 
hrough 111 r<2ceivcd project services from September ,' 1980 through May 
ices, from September, 19 BO 



p'<.05 
i><.01 
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- Table 4 j ; 

Means and Standard Deviations for Treatment and Control 
Students on Spring, 1983 Survey McacureB • 



ool 
d 

up 



Total 
Del inr - 
qucncy 



School 
Rewards 



School 
Punish- 
ment s 



Schaol 
Konat- 
t endancc 



Positive 
f Self 



M SD N . M • SD, N M, SD < N M SD . N 'M SD .N , M 



School 
Attach- 
Concept . y Jhent 
~~ — — — 

SD 



Involve- 
ment • 



Educ, 
a tibns 



N' M SD N M 'SD K 



ih TT 
argct 
>ntr6l 



.16 .20 40 
.12 .14 36 



.10 .Hi 38 
.08 ,13' 30 




.14 .15 69- 
\AS .16 '53 



.40 .36 42 -.34 .30 40' ^28 .34 49 .74 ,.18 37* .77 .21 A2 
;37'.30 50 .33 .2^ 50 .17 ^33 56 * .75 .18 44 .80 ..19 49, 



.36 .33 - 42 .29 .26 42 .16 .34 -49 ,.75 .17 31 .68 .27 .41 
.26 .24 26 .36 .26 25 .24. ,5*6 33 .70 .17 15" .69 .24 26' 



.30 .33 40 .27 .27 40 .14 .30 -48 .72 .18^35 .69 .27 39 
.21 .22 13 .17 .21 13, .11 .29 14 .71 .^11 if. . .68 .21 13 



.25 .^28 60 .33-^29 60 .48 .42 63 .78 .17 53 '..6^ .24 63 

22 .27 63^' .26 .2?/63^*.45 .42 69 .76 .15 • ASi .69^.23 60 

.19 .27 '67 .20. .24 69 r&l*.38 75 .81 .15 ^1 .74 .21*68 

.24 .27 53 .28 .27 53 .67. .40 57 .79 .18 47 .72.24 50 



.33 n2T>4(r 2.49 1.67 47 
.27 .20 47ik2,87 1.76*55 



.26 .24 45 2.61 1.80 49 
.20 .20 32 2.55 1,84 31. 



.23 .17' ' 44 2.42 1.78 47 
.22 .21 IQ 2.67. 1:68 15 



.22 .21 ' 59 1.94 1.46 62 . 
.19 .17 63 2.26 1,58 69 



.17 .17 . 70 2.35 1.53 74 
.20 .16 '55 2.36 1.48 59 



Bh lit 
arget *' 
ontrol 



11 .14 '59 .24 .27 64 ^"lO .27 63 .JA ^38 67' .77 .16 58 '- .70 .23 61 .-25 .20 
.11 .14 ,61 .29 .30 70 ' .17 .2^6 71 .30 .36 ,74* .76 ..,16 62 . .71 .22 69 ' .30 .24 



60« 2.57 i;68 67 
68, 2.15 1.57 74" 



desired tiVrection of change is positivp except for School Pun ishmeiasY Total Delinquency and School 
. All measures are taken from the Sprinfe 1983 SAES student survey.' * * ^ ' 
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1981 to 1982 period for high schools and the diseontinued ^middle school , the 

1982 to 1983 period fop the discontinued middle school , and the 1981 to 1983 
»p«riod for the mifidle schoola that received continuous program servi^ces* 
Table 2 reports results for^the student outcomes in the rightmost •portion of 
t^e theory diagram (Figure 1 ), and Table 3 reports resMts for ^the' factors 
theorized to produce those* student outcbmeB.. , 

We were prohibited fi?om asking middle School students about their delin- 



quency experiences during the first survey administratidn, so cpmparison 
Qf 1981 to,;1983 scores is not, possible. In resul ts Vrepx)r ted elsewhere 

(Got tf redson, 1984) none of the middle schools showed significant' changes in 

• * • ' . ■ „ . V • , . , ' ■ ' ' • , • _ * ' 

level of delinquencjT^ from 1982 to 1983 , . al though the comp>arison\school,'8 
ihcrease ip delinquency ^approached significance. Three of the. project. 



schools and the f^Drmer ^ proje<^t school showed noosignif iqant dec 
delinquency and th^e other project schools* showed no change - 



r eases in 



The results fpr the measures of student factors implied by thk program 

theory * (Tabl e '*;2 ) provide support for the program;^ The program schools, on 

the average, improved on 68.2% of the measures. The comparison schools 

improved on ortiy 26.8%. Although most of the ^-statistics do not reach qpn- 

entional significance levels, all but. one of the dif ferences f or the pro- 

gram Schools that reach . statistical signif icance '^r e in the positive direc- 

tion. ' For the comparison school s , one is in the positive and one in the 

negative direction. The* former project school (Middle IV) shows reversals 

for five of the seven measures y vith improvements evident while the proje<^t 

' * , . ■ '' •■ ' * ' , 

was operating, and declines following, the removal of the program. . 
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• • • ■ '.■'■•* ■ ■ ' ; v;. ■ . ^ ■ : ■ ■ ■ ■-; ■ , , ; ■ 

The results for the intermediate outcomes of the. program shown in Table- 3 
are more supportive of Ihe program. , The program school s improved, on the 
average, on 81.5% of the measures, ^ The comparison schools imprlSved on 33Z. 
^ The significant resul ts for the program schools aire all in. the positive 
direction and for the vcimparisonv schools they are both iii\the negajfive 
_ direction. The results for the former project middle gchOol are diffic^t 
^ to interpret; Reversals similar to those on Tablef 2 -are - evident f^Sr two 
measures of the student . composition of . tie ^cliool— jBeiief in, Rules and 
Alienation — but for the teacher repoi;ts of school climate the school contin^ 
ued to or, started to improve. ' \ - - 

direct Services ' . , . * . . 

Table 4 shows treatmentrcontrol coijparisons for student outcomes targeted- 
by the- direct pervice component of the program. lx\ summary, the groups 

' . ■ ■ ' ■> " • : 

appear equivalent on most measures after two years of v treatment. Analysis 
of variance using treatment and ^chool as factors yielded nb significant 
treatment effects or , treatment x school interactions. * . 

Evaluation results from the first year of program servi<6s showed signi- 
ficant positive treatment ef fects on school grades and standardized achieve- 
ment test scores (D. Gottf tjedsOn, 1$83). Future analyses on tl^ese outcomes 
may replicate the 1981-82 year finding.. ' - 

Discussion . * 

pur evidence supports the project theory at the schooinevel . but not at 

: ■ , . ' ■ ■ V'' , ' 

the individual level of treatment. One li4cely explanation for this is that 
the theory was iroplemepted only at the school level. 
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' The theory diagrammed in Figure 1 evolved over the tjJiree years of project 
operation, The major chan^ to the project • thedry resulting from pijo^ram , 
development efforts was- the highlighting of the triangle of iBtermediate 
student, factors, whiciv did not occur until the Spring of the final year of 
program operations.^The sihOol factot/ had aiways been theorized as cau.r&l 
factors, anfl pr ogr^Uctiv it ies -aimed ^t altering those factors had always 
been a palrt of the program plan. ' ■ 

, The specialists who ^mpl^ented the Vogram in the ^school s on a .day- to- 
day basis may have been largely unayare of the theory underlying the pro- • 
gr&. They did not engage iln program development activitie^s aimed at clari- 
fying the. theory. and the pr\gr am managers' inter 'act ion s_ with, the ^ 
specialists .were -focused 'primarily on clarifying implementation standards, 
providing technical assistance, and monitoring program* activities. Although 
"the .specialists were oriente^d to the project philosophy in August. 1^)80. the 
main idea conveyed during .'that orientation w^» the same theme that ran 
"through the grant prbpo'salf^ A> integrated- approach to the problem of dis- 
cipline'is necess'aryl Schpols must attend to the affective as well" as^ to 
the' academic needs of students. The cedtrality of -self-concept and, social 
bonding to the theory^were never m^de" explicit to the specialists. 

' Interviews with the specialists during the f inal y^ of project opera- 
tions supported this hypothesis. Specialists'varied greatly ^n^hei,^ under- 
standing of the uncierlying principles of , the project.. For example, in re- 
sponse to, the question. "Ho^ does the projec^f^ct delinquency?", we 
received responses t'^t ranged .from-;it doesn't; we le!^. tfie school adminis- 
tration handle the hard cases" to- a full-blown el^lana^ion of how the pro- 



gram 'is expected 'to decrease delinquency by yincreasing j fielf-cj^^S*^. . 
creating a "senseTbf bilonginf** in the school* Somewhere in-between were 
explanations citing the importance of ^intermedia^te student factors ofher 

than those emphasized in the project -theory . All specialist s ourderlstood the 

• ' ■ ■ ■ , ■ J 

importance of increasing academic achievement for target students, but few 
placed equal emphasis on raising self-esteem or strengthening social bonds. 

le one school whose speci*alist8 had a clear understanding of the undet;- 



lyjng program theory (Middj[e III in the tables) expferiencec^ the most di^astic 



7 

ry (Middje 

improvements bn th ft outcome measures . The sphool improved on five of the 
seven strident outcomfe factors implied by the theory, and the improvements m 
Setf^c^cept and two of the sbfcial bond measures (School Attachment and Com- 
mitment) reached significance. It 'improved bp all nine of the school level 
intermediate outcomes impl ied by the theory, and the improv^ents in Teacher 
Morale. Belief in Rules and Alienation reached significance. ' ^ 

The'low level of co.nsensus about the. underiy ing progr&n theory was proba- 
bly more > detritnental to the direct service interventions than to the 
8chool--wide interventions. Project managers had more control oyer the the 
school-level '^activities and t^he school-level activities were more standard- 
L^d thari-^wfere the individual services. We have no way of knowing exactly 

/what went on (^n individual counseling or tutoring sessions w^th the target 
students, but it is likely that specialists fotused on student attitudes and 

. behaviors other than those specified in. the theory. In shortgj(||j|||(iali^t s 
had considerable freedom to exercise professional judgement in their direct 
contacts with target students. The common focus on academics mayv explain 
the, previously-observed treatment effect on school grades and achievement 
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test scores, and the low level of consensus aBout the affective stud^t^^ 
objectives)may explain the absenc of treatment effects in these Weas*. 

Theory is a useful tool for lise in selecting .a program design, but it is 
also^ an essential guidfe for program operations. ] Program implementers need 

^ ' ' ■ ■■ . *\ ^, I / ■ * ^ 

templates to guide, daily . interactiohs and de'cisionmaking. School improve- 
ment effoxts — and any organizational dev^elopmept efforts — would benefit^from 
an explicit statement of .the. theory underlying the effort and from knowledge 
that the actions of program managers- ^nd program implementers \alike are 
guided by the theory. . In the abs^ce of a clear understanding of the theory 
underlying the program, implemente rs wi ,ll rely on their own persanal tKeo- 
ries- I ' ' . 
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